Web Survey Bibliography
Socio-demographic characteristics of interviewers have a potential biasing effect on data quality. Among others race/ethnicity and gender are the most prominent characteristics analyzed in the literature. Evidence from the literature suggest, that sensitive items – especially questions on gender-related topics – evoke gender-of-interviewer effects. Sometime effects are predominant in opposite gender settings where interviewers of one sex administer a survey to a respondent of the opposite sex, sometime scholars observe reverse interrelations. So far it remains unclear whether these effect occur because respondents are prone to measurement error on the reporting stage (social desirability) or whether the gender or the interviewer modifies the perceived question meaning.
In recent years, Web surveys have become a standard survey mode. So far, online questionnaires resemble their paper counterparts to a great extend: online measurement instruments rely mostly on visually presented written questions with associated response categories. However, compared to paper and pencil questionnaires Web surveys allow for more rich communication with the respondent: graphical elements, pictures, and animated GIFs are used to enhance the appearance of web pages. As a result some Web surveys make use of a humanized interface, e. g. a picture of the investigator, pictures of people performing activities that the respondents are supposed to report on and the like. Earlier studies could demonstrate that those low-intensity humanizing elements have no or only marginal effects on the responses obtained.
However, with the wide spread availability of broadband Internet connections video and/or audio are being used in Web surveys as well. Accordingly, in this study we will assess the impact of pre-recorded video clips of interviewers reading the questions to the respondents. This should enhance the social presence of a human in the survey situation, which in turn should induce more pronounced reactions from the respondents in response to theses humanizing factors.
The paper reports results from a field-experimental study on the impact of video support in Web surveys on data quality. Within a Web survey among university students a standard interactive online questionnaire was used. A random sub-sample answered a version of the questionnaire that consists not only of written questions but also of corresponding video files of interviewers reading the questions to the respondent. 800 respondents were randomly assigned to either of three versions: (1) a traditional text-based version of the questionnaire, (2) a video-enhanced version using a female interviewer and (3) a video-enhanced version using a male interviewer. The survey covered a variety of questions on relationships and sexual behaviors including several highly sensitive items on sexual practices, sexually transmitted diseases and the like.
In the presentation we will assess the impact of the gender of the interviewer (in relation to the gender of the respondent) on standard data quality indicators: item non-response, social desirability, over- and underreporting. Preliminary finding suggest, that the video in itself does not affect data quality negatively. However, for highly sensitive questions and topics that relate to the self-presentation of the respondents in front of an opposite-gender interviewer, gender of-interviewer effects are to be observed.
General online research (GOR) 2008 (abstract)
Web survey bibliography (4086)
- Using global online panels; 2008; Pearson, C., Smith, E., Ridlen, R., Zhang, H., Cooper, A
- The quest for on-line quality research; 2008; Rhall, T., Fine, B.
- Visual Design Effects on on Respondents Behaviour in Web-Surveys. A Design Experiment; 2008; Greinoecker, A.
- Effects of Privacy Assurances on the Online Measurement of Psychological Constructs; 2008; Witzki, A., Kramer, J.
- How Web 2.0 Technologies Can Become a Valuable Part of Online Research; 2008; Jaron, R.
- Respondent Authenticity - A biometrical approach to authenticate panelists; 2008; Wachter, B., Bender, C.
- Not Mixed-Mode but Switch-Mode; 2008; Höglinger, M., Abraham, M., Arpagaus, J.
- The Impact of Cognitive and Computer Skills on Data Quality in Computer Assisted Self Administered Questionnaires...; 2008; Brecko, B. N., Vehovar, V.
- Optimal Contact Strategy in a Mail-and-Web Mixed Mode Survey; 2008; Holmberg, A., Lorenc, B., Werner, P.
- 10 Years of Meinungsplatz.de: Success in the Collection of Data for Targeted Audiences, Such as the...; 2008; Weyergraf, O.
- Self-selection in Online Access Panels: No “Little Difference” in the Recruiting Process...; 2008; Wirth, T.
- Mobile Market Research; 2008; Maxl, E.
- Online vs. Offline in Mobile Surveys; 2008; Neubarth, W., Maier, U.
- Gender-of-Interviewer Effects in Video-Enhanced Web Surveys. Results from a Randomized Field-Experiment...; 2008; Fuchs, M.
- The Online Use of Randomized Response Measurements; 2008; Snijders, C., Weesie, J.
- The Influence of Human Cues on Drop-out and Answer Behaviour within Web Surveys; 2008; Oesterlau, T., Geißler, H.
- “For Example…,” How Different Example Types in Online Surveys Influence Frequency...; 2008; Berent, M., Krosnick, J. A.
- How Too Little Can Give You a Little Too Much: Determining the Number of Household Phone Lines in RDD...; 2008; Merkle, D., Langer, G.
- Learning and fatigue during choice experiments: a comparison of online and mail survey modes; 2008; Savage, S. J., Waldman, D. M.
- Avoiding Massive Automated Voting in Internet Polls ; 2008; Basso, A., Miraglia, M.
- Internet surveys; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G.
- Reasons for nonresponse in a web-based survey of alcohol involvement among first-year college students...; 2008; Cranford, J. A., McCabe, S. E., Boyd, C. J., Slayden, J., Reed, M. B., Lange, J. E., Scott, M. S.
- The influence of mobile telephones on telephone surveys; 2008; Kuusela, V., Callegaro, M., Vehovar, V.
- Telephone and Web: Mixed-Mode Challenge ; 2008; Greene, J., Speizer, H., Wiitala, W.
- Fast times and easy questions: the effects of age, experience and question complexity on web survey...; 2008; Yan, T., Tourangeau, R.
- Mixed Methods Sampling; A Typology With Examples; 2007; Teddie, C.; Yu, F.
- Web Application Stress Testing and Blaise IS; 2007; O'Reilly, J. M.
- Analyses of Web Survey Data; 2007; Kuusela, V.
- Cognitive aspects of survey methodology; 2007; Schwarz, N.
- Panel Quality: Tips to Achieve Pure Sample, from Recruitment to Long-Term Engagement; 2007; Fitzgerald, D.
- Non-Response in the Panel Study of Belgian Households (1992-2002): An Output and Process Evaluation; 2007; De Keulenaer, F.
- Sensitive questions in surveys; 2007; Tourangeau, R., Yan, T.
- Webmasters, web policies, and academic libraries: a survey; 2007; Hendricks, A.
- Toward a Definition of Mixed Methods Research; 2007; Johnson, R. B., Onwuegbuzie, A. J., Turner, L. A.
- Sample bias, weights and efficiency of weights in a continuous web voluntary survey; 2007; de Pedraza, P., Tijdens, K., de Bustillo, R.
- What is Sexual Harassment? It Depends on Who Asks! Framing Effects on Survey Responses; 2007; Galesic, M., Tourangeau, R.
- Mixing modes of data collection in surveys: A methodological review; 2007; Roberts, C.
- Differences between respondents and nonrespondents in an Internet survey recruited from face-to-face...; 2007; Bandilla, W., Blohm, M., Kaczmirek, L. & Neubarth, W.
- XSight and the shaping of Marketing Analytics; 2007; Birks, D. F.
- Whither statistical metadata?; 2007; Westlake, A.
- Web survey design; 2007; Ma, Q., McCord, M.
- Web survey and representativeness: Close to three in ten Canadians do not have access to the Internet...; 2007; Bourque, C., Lafrance, S.
- Video mediated communication: Implications for surveys; 2007; Anderson, A. H.
- Utopia - a complete research management system; 2007; Brandwood, T.
- Triple-S: The broader horizon; 2007; Wright, Ge.
- The use of seasonal adjustment software within the Office for National Statistics; 2007; Hussain, F., McLaren, C. H., Stuttard, N.
- The Internet audience. Constitution & measurement; 2007; Bermejo, F.
- The influence of advance letters on response in telephone surveys; 2007; de Leeuw, E. D., Callegaro, M., Hox, J., Korendijk, E., Lensvelt-Mulders, G. J.
- The impact of cookie deletion on the accuracy of site-server and ad-server metrics: An empirical comScore...; 2007; Abraham, Ma., Meierhoefer, C., Lipsman, A.
- The challenge of geocoding large-scale travel surveys; 2007; J.Smith, A. J.